Unusual percolation in simple small-world networks 
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We present an exact solution of percolation in a generalized class of Watts-Strogatz graphs defined 
on a f-dimensional underlying lattice. We find a non-classical critical point in the limit of the number 
of long-range bonds in the system going to zero, with a discontinuity in the percolation probability 
and a divergence in the mean finite-cluster size. We show that the critical behavior falls into one of 
three regimes depending on the proportion of occupied long-range to unoccupied nearest-neighbor 
bonds, with each regime being characterized by different critical exponents. The three regimes 
can be united by a single scaling function around the critical point. These results can be used 
to identify the number of long-range links necessary to secure connectivity in a communication or 
transportation chain. As an example, we can resolve the communication problem in a game of 
"telephone" . 

PACS numbers: 64.60.Ak, 05.50, 02.10, 64.60.C 



I. INTRODUCTION 



Small-world networks 



In a 1967 study on social networks Stanley Mil- 
gram found that on average a randomly chosen person 
in the midwest USA could be connected to a target per- 
son in Massachusetts through a string of first-name ac- 
quaintances in only six steps. While this notion of "six 
degrees of separation" rapidly acquired folkloric status in 
popular culture [ 2] , the structure of the underlying net- 
works remained largely unexplored until recently. The 
"smallness" was attributed to the logarithmic scaling 
with graph size of distances between nodes on random 
graphs 3]. Actual social networks are far from random, 
however. Today, social and other networks are frequently 
described as consisting of mutually-interconnected local 
groups together with some far-flung ties. Interest in the 
properties of such partially-ordered networks was sparked 
by the work of Watts and Strogatz [J], who in 1998 intro- 
duced and studied numerically a "small-world" network 
model in which a controlled degree of disorder is intro- 
duced into initially ordered graphs by randomly rewiring 
some fraction of their links. A schematic representation 
of a small-world graph is depicted in Fig. [TJa. 

Watts and Strogatz's observation that even a small 
degree of randomness changes the scaling of the mini- 
mum graph distance between randomly-chosen nodes, I, 
with the total number of nodes, N, from the linear be- 
havior of ordered graphs to the logarithmic scaling as- 
sociated with random graphs, provoked a flurry of in- 
terest. The scale dependence of I, has been obtained 
by renormalization-group and mean-field analysis [(| . 
In particular, Moukarzel [7[ showed that for systems of 
size L on a c£-dimensional underlying lattice there is a 
crossover length r c ~ log (pi), where p is the density of 
shortcuts, such that on a scale r < r c , l(r) scales as r, 



whereas on larger scales l(r) ~ r c . 

Today, the term "small-world" has come to describe 
any system displaying a combination of strong local 
clustering with a small graph diameter. Mathias and 
Gopal 8| have shown that optimization of a regular 
graph for high connectivity and low total bond length 
gives rise to small-world behavior. Interestingly, the op- 
timized graphs are distinguished by the generation of a 
relatively small number of highly-connected "hub" ver- 
tices, rather than a random distribution of long-range 
links as in the Watts-Strogatz model. Hub-dominated 
networks are also generated by a model for a dynamically 
expanding graph proposed by Albert and Barabasi Q 
to explain the scale-free (i.e. power-law) distribution 
in vertex connectivity common to many real-world net- 
works, such as the World-Wide Web and the science ci- 
tation database. For scale free networks, it has been 
shown [l(| [ll], OjJ , that the network is even smaller than 
small world networks, i.e., has a sub-logarithmic aver- 
age distance between nodes. A further study of real- 
world networks by Amaral et al. 13| discerned two other 
classes of behavior in small-world networks in addition 
to scale-free graphs, characterized by truncated power- 
law and rapidly-decaying connectivities respectively, and 
proposed how such behavior can arise due to constraints 
placed on the Albert-Barabasi model. 

In addition to work on the properties of small-world 
networks themselves, recent attention has focused on 
the behavior of physical systems defined on small-world 
graphs, including Ising models (T3 |. neural networks [l5l |. 
and random walks [la . [l7T |. There has also been work 
on models of disease epidemics using site and bond 
percolation defined on small- world graphs (See, e.g., 
Refs. |l||, QjJ [2(|) as described below. Evolving conta- 
gion processes on small- world networks have been inves- 
tigated in Ref. [2l| , and the dynamical response of com- 
plex networks due to extenal perturbations is studied in 
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Refs. [12, SH- The analysis of implications of small- world 
networks for goal directed social network behavior is pre- 
sented in Ref. [24J. For some contemporary reviews of 
small- world networks and networks in general see, e.g., 

Refs. mm S3]. 

The wide ranging interest and implications of small 
world networks have also led to a need for precise un- 
derstanding and, where possible, exact solutions of the 
fundamental properties of these networks. In this pa- 
per we focus on identifying unusual properties that arise 
in the case of small world networks on an underlying one 
dimensional lattice. We provide exact solutions for a gen- 
eralized model and study the behavior in the limit of few 
long range links — a limit we find is very sensitive to the 
manner in which it is obtained. We also point to practical 
implications for securing connectivity in one dimensional 
transportation and communication chains, showing how 
failure of some local links is overcome by the existence of 
long range links. 



B. Percolation on small- world graphs 

Percolation is quite sensitive to the geometry of the 
underlying lattice. One dimensional lattices are gener- 
ally inappropriate for representing the graph underlying 
social networks, however, they may be appropriate in 
specific contexts. Consider, for instance, a chain of is- 
lands, cities, or nodes in an ad hoc or wired network 
situated in a nearly linear formation, say along a road. 
Such a configuration is extremely sensitive to breakdown, 
if even a small number of the links connecting the nodes 
is removed. This follows from the well known result 
that one dimensional systems only percolate in the limit 
of zero failure rate. To fortify the structure of such a 
network, random long range links may be added that 
can backup missing short range bonds. For road trans- 
portation long range bonds may be added by airlines or 
boat lines, for wired communications long range bonds 
might be provided by microwave or satellite communi- 
cation links. The important question: "How many long 
range links are needed to replace an (expected) number of 
short range failed links?" is addressed in this manuscript. 

For a simple ring structure it will be shown that for 
any constant ratio of long range bonds added to replace 
removed short range bonds, some nodes remain isolated 
from the rest. However, if only a quarter of the number of 
the failed short range bonds exist as long range shortcuts 
the chain is not broken — a giant connected component 
exists comprising a constant fraction of the nodes. 

As an example, this shows how to achieve reliable com- 
munication in a game of "telephone." In the game, one 
person tells a second person something, the second tells 
a third, and so on down a chain. For a long chain, and 
even a reasonably short chain, errors garble the commu- 
nication. Our results show that if there are also long 
range links of communication along the chain, compris- 
ing a quarter of the short range links, the random errors 



that are formed do not cause errors in the answer. 

We note the difference in behavior of short range and 
long range fortifying links. Short range fortification in 
a fc-ring architecture, in which each node is connected 
to its 2k nearest neighbors leads to an exponentially de- 
creasing probability of disconnection in k. Still, in the 
limit of long enough chains, a fixed k implies that a chain 
always breaks. Moreover, this method of reinforcement 
is expensive in the number of links needed. The prob- 
ability of a node being disconnected from all nodes in 
one direction is p k . A lower bound on the probability of 
disconnecting the ring at n locations can thus be approx- 
imated by Np k /n. For any constant p and any n, as large 
as desired, keeping this probability vanishingly small re- 
quires at least k ~ In TV. Thus, resiliency to random 
failure requires at least 0(N In N) bonds (corresponding 
to the known collapse of the one dimensional percola- 
tion), whereas, as will be seen, the number of long range 
links needed is linear in N (and actually lower than N). 
It should be noted however, that for random long range 
bonds 0(iV In JV) bonds are still needed to ensure that 
all nodes are connected [3|. 

The best practical solution may be to combine short 
range and long range reinforcement. We find that for 
k > 1, and small removal rates of the short range bonds, 
the network will remain connected (up to a statistically 
insignificant fraction of the nodes) for any constant ra- 
tio of added long-range bonds. Thus, the addition of 
relatively few random long-range bonds can ensure per- 
colation and global connectivity. 

Recent studies of percolation on small world net- 
works [28| have antecedents in the study of bond- 
percolation S^] whose methodology is the basis of our 
analysis. Small-world-type graphs, with their mixture 
of ordered local and random long-range bonds, present 
the statistical physicist with an interesting percolation 
model. It turns out that the construction of the original 
Watts-Strogatz (WS) model — in which shortcuts are 
created by reconnecting only one end of an original lo- 
cal bond — renders it analytically hard to treat, due to 
the correlations it introduces between the distribution of 
local and long-range bonds. For this reason, most analyt- 
ical work is done using a variant of the model in which 
long-range bonds are added between randomly chosen 
pairs of sites. This change does not affect the small- 
world behavior of the resulting graphs, but makes them 
far easier to treat analytically; we will refer to both the 
original and the variant as WS models. Figure [TJ; gives 
an example of a variant WS graph. 

Newman and Watts [28| have performed both analyt- 
ical and numerical analysis of site percolation on such 
a model with a local bond coordination number k and 
a density 4> of shortcuts added per local bond; no lo- 
cal bonds were removed. Their results, suggesting site- 
percolation on WS graphs is similar to that on random 
graphs, were confirmed by more rigorous work on the 
same system by Moore and Newman [TH, S3]. In ad- 
dition to demonstrating that site percolation on small- 



world networks is in the same universality class as ran- 
dom graphs (i.e. mean-field), Moore and Newman pre- 
sented a formal solution to the bond percolation problem 
with independent probabilities of local and long-range 
bonds. They were able to solve this for k = 1 and k = 2 
to show that the percolation transition in such systems 
also displays mean-field behavior. 

Newman and Moore's results on bond percolation in 
small-world systems had in fact been anticipated some 
17 years earlier by Kaufman and Kardar [2^|, who solved 
the bond percolation problem on what would now be 
regarded as a k = 1 WS model with general nearest- 
neighbor and long-range bond probabilities (p s ,Pi) re- 
spectively. In Section [II] of this paper we present a review 
of Kardar and Kaufman's method and their results de- 
scribing the percolation transition. In Section HTTl we then 
use the formalism developed in Rcf. 29] to consider the 
critical percolation behavior of a standard WS graph by 
imposing the relation pi = 1 — p s , corresponding to one 
long-range bond being added to the system for every local 
bond removed. This is, as far as we know, the first ana- 
lytical treatment of the original Watts-Strogatz model [4[ 
including rewiring rather than addition of shortcuts. We 
then solve the problem for a generalized graph in which 
we allow the number of long-range bonds added for every 
short-range bond removed to vary continuously. We also 
present a brief discussion of percolation on generalized 
WS graphs defined on fc-rings and higher-dimensional lat- 
tices. An alternative approach to obtaining the results 
using generating functions is presented in the Appendix. 
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FIG. 1: Examples of small-world graphs: (a) A fully con- 
nected ordered ring with N — 20 vertices, (b) A graph gen- 
erated by the original Watts-Strogatz algorithm with k — 1 
and pi — <f> — 1/5, giving p s — 4/5. Note that every long- 
range link is created by re-attaching the far end of the broken 
short-range link, (c) The Watts-Strogatz variant used for an- 
alytical calculations. Again k = 1 and cj> = 1/5, but this time 
the addition of long-range bonds and deletion of short-range 
bonds is carried out independently; this makes the appear- 
ance of disconnected (finite) clusters more likely but does not 
prevent the appearance of small-world behavior, (d) A gen- 
eralized Watts-Strogatz graph with k = 1, p = pi = 1/4, and 
n = 1/2, giving p a = 1/2. 



II. PERCOLATION WITH 
NEAREST-NEIGHBOR AND LONG-RANGE 
BONDS 

A. Model and formalism 

Quite generally, the Kastelyn-Fortuin formalism [3l| 
allows us to relate the bond percolation problem to the 
q — ¥ 1 limit of the Potts model. Let us start by consider- 
ing g-state (Potts) spins Sj, on a lattice of N sites. The 
spins are assumed to be subject to both nearest-neighbor 
and infinite-range interactions, with a total energy given 
by the Hamiltonian 

-0H(K,J,h) = A'^i - 

(ij) 

i i,j 

The long-range interaction has to be scaled by 1/N to 
achieve a proper thermodynamic limit, and h is a sym- 
metry breaking field. The cluster-size generating func- 
tion is given in terms of the Potts free energy f(K, h, J) 



by 

OO 

G(p a ,pi,h) = J2 n s(Ps,PiK sh (2) 

s=l 



Here the nearest-neighbor bond occupation probability is 
p s = l—e~ K , the long-range bond occupation probability 
is 2pi/N = 1 — e~ J / N (giving an average of Npi occupied 
long-range bonds), n s is the mean density of s-sized clus- 
ters, and 1 — e~ h is the ghost bond probability. "Ghost 
bonds" are the percolation equivalent of a magnetic field 
in the Potts model, and can be considered as connecting 
each site in the lattice to a single super-site; as a re- 
sult any non-zero ghost-bond probability automatically 
results in the formation of an infinite (spanning) cluster, 
since all sites with occupied ghost bonds form part of the 
same cluster. An example of a cluster involving nearest- 
neighbor, long-range, and ghost bonds is given in Fig. [5] 

The main quantities of interest in percolation are the 
percolation probability, and the mean finite-cluster size: 
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FIG. 2: Example of six sites forming part of a connected 
cluster with nearest-neighbor bonds (solid lines), long-range 
bonds (dot-dash), and ghost bonds (dashes). The ghost bonds 
connect sites (1), (3), and (5) to the ghost super-site, indi- 
cated by a black circle. For any finite value of h, a finite 
proportion of sites in the graph will be connected together 
via ghost bonds to the super-site, and so all clusters involving 
ghost bonds must belong to the infinite cluster. 



P(p s ,pi), is defined as the probability that a site belongs 
to the infinite cluster, while S is the expected size of the 
cluster of which the site is a member, averaged over all 
finite cluster sizes. They are given in terms of G(p s ,pi, h) 
by 

P(p a ,Pl) = l + -^G(p s , Pl ,h = + ), (4) 



Eq. © by 

/ = min 

-J 



J 9 

-Y 

2 ^ 

ct=l 



x 2 a + f (K,h + Jxi, • • • , Jx q ) 



(9) 



Jm 



Jq(q - 1) 



m 2 + fo{K 7 h + qjm) 



S(p s ,pi) = -^G(p s ,pi,h = + ). 



(5) 



where in the last line we have used the observation that 
the the magnetizations of the Potts model 129, 32] 

and introduced a parametrization 

xi = 1/q + (q — l)m, x% = ■ ■ ■ = x q = 1/q — m. 

Setting q — 1 and using Eq. ([3]) , we obtain the cluster- 
size generating function for percolation with nearest- 
neighbor and long-range bonds, 

G{p Sl pi 7 h) = - min[p ; (TO - l) 2 - G {p Sl h + 2pim)] m , 

( 10 ) 

where Go(p, h) is the cluster-size generating function for 
percolation with only nearest-neighbor bonds. We note 
that m, the value of m that minimizes the expression in 
Eq. fTU]) . is the percolation probability P. 

It is simple to calculate the function Go (p, h) in one 
dimension using Eq. ([2]) ; to form an s-size cluster requires 
a sequence of (s— 1) occupied bonds with an empty bond 
at each end to terminate the sequence. Thus n s = (1 — 



To find the free energy of the Potts model, we introduce 
the partition function 



p s ) 2 p s s , and performing the sum we find 



G {p s ,h) 



(11) 



Z : 



in* 



-(NJ/2)x 2 a 



)E 



(6) Substituting this result into Eq. (|10p we obtain the 
generating function for bond-percolation on a graph with 
nearest-neighbor and long-range bonds, 



exp I K^5 Si>Si + ^[{h + Jxx)5 Sul + 

(ij) i 



G(p s ,p h h) 



pi(m - l) 2 



(l-Ps) 2 



Carrying out the integrals over x and dropping terms of 
order exp [log N/N], we obtain the partition function for 
the original Hamiltonian introduced in Eq. ([1]) as 



-H{K,J,h)/kT 



-Nf(K,J,h) 



(7) 



where f(K, J, h) is the free energy of our Potts model. If 
instead we first sum over spins in the partition function 
of the integrand in Eq. ©, we obtain 

Z =L ° 00 nLi^ expHTVJ/2)^ 2 

a=l 

-Nf (K,h+J Xl> ...,Jx q )U8) 

where fo(K, h + Jx%, • • • , Jx q ) is the free energy of the 
nearest-neighbor Potts model, Tt(K, J = 0, h%, ■ ■ ■ , , h q ), 
in magnetic fields hi = h+ Jx\, ■ ■ ■ , h q — Jx q . 

In the thermodynamic limit N — > oo, a saddle-point 
method [HJ relates the two free energies in Eq. Q and 



(12) 

This is the result that we shall be using for the rest of 
this paper; we note that for percolation in the context of 
small-world networks only the h — * + limit is relevant. 



B. Mean- field percolation 

Given that in the vicinity of the percolation transition 
we expect P = m to be small, we can perform an expan- 
sion of Eq. (fl"2"|) in powers of m to give (taking h = 0) 



G(j>s,Pi,0) 



1 ~Ps 



Apfm 3 1 + 4p s - 1 - ™ 2 



pi inn) <j pim 

Pi 



l-2p, 



l+Ps 



l-Ps 

G(m 4 )l .(13) 



(1-Ps) : 



The phase transition thus occurs when the coefficient of 
m 2 changes sign, giving a transition boundary 



2 P i 



1 +p s 



(14) 
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Note that since m cannot be negative, the presence of a 
cubic term does not imply a first order transition. Defin- 



ing 



t = 2 Pl 



l+Ps 



- 1, 



we find the critical behavior at the transition to be 



(15) 



p = 
s 



0, t < 0; 
i 3 , i > 0; 

0, t < 0; 
<, t > 0; 



and 



t~ 



Using the standard definitions [H, G sing - t 2 "" 
and S ~ i~ 7 , this gives critical exponents 



a 



-1, /3 = 1, and 7 = 1, 



(16) 

(17) 
(18) 

(19) 



typical of mean- field behavior [3J, l35fl . in agreement with 
the results of Moore and Newman [30, [3(1 . 



III. GENERALIZED WATTS-STROGATZ 
GRAPHS 




FIG. 3: Small-world trajectories: The lines (a), (b), and (c) 
show examples of small-world trajectories superimposed on 
the phase diagram of the more general percolation system. 
The arrows show the direction of decreasing p. Trajectory(d) 
shows a non-small-world trajectory for which mean-field be- 
havior holds at the transition. Trajectory (a), with n = 1, cor- 
responds to the standard Watts-Strogatz graph and is clearly 
always percolating. Trajectories (b) and (c), with n = 1/4 
and n = 1/8 respectively, are always in the non-percolating 
regime. 



A. Percolation 

The results of Section |TT1 describing percolation 
with general nearest-neighbor and long-range bond- 



occupation probabilities, give a solution to the bond- 
percolation problem as defined on a small-world 
graph [l8|, [3(| , but are not quite appropriate to describing 
the percolative behavior of the graph itself. Recall that 
in the Watts-Strogatz model, the proportions of long- 
range and nearest-neighbor bonds are not independent, 
but rather a fraction p of nearest-neighbor bonds is re- 
placed with long-range bonds. Thus pi and p s are firmly 
connected by the relationship p — pi = (1 — p s ). For any 
value of p, the WS graph occupies a point in the (p s ,Pi) 
configuration space of the more general model which sat- 
isfies this relation, and varying p describes a trajectory 
through this configuration space (see Fig. [3ji) . The ap- 
propriate equation for describing the percolative behavior 
of the k = 1 (nearest-neighbor) Watts-Strogatz graph is 
therefore given by substituting for p s and pi in Eq. (|12p , 
giving us the cluster-size generating function for the WS 
model as 



G(n,p, h) 



p(m — 1)' 



P 



gh+2pm 1 -|- TJ 

(20) 

According to Eq. (|15[) . the controlling parameter t for 
this system is given by £ = 3— p 2 < i < 3, and there- 
fore we expect the system to lie deeply in the percolating 
phase for all values of p. Nonetheless, it is not difficult to 
solve Eq. ([20|) numerically, and the resulting graphs of G, 
P, and S as a function of p are illustrated in Fig.UJ The 
divergence of S as p — > indicates that p = represents 
some kind of critical point. Additional evidence for this 
comes from the fact that while P comes in linearly to 
the limiting value P = vo/2 ~ 0.866 as p — ► 0, at the 
exact point p = the bond configuration of the system is 
that of a completely connected linear chain and therefore 
P = 1 is the only physically acceptable value. Therefore 
we are faced with a divergence in S and a discontinuity 
in P at p — 0. Taken together with the fact that p is 
the only free parameter in the system once we have set 
h = 0, it is reasonable to take p rather than t to be the 
appropriate control parameter for percolation in the WS 
network. 

With this in mind, we can compare the more general 
results of Eqs. (fl6"]l. (|P7]) and ||TSJ) to the p -> behavior 
of the WS network, as indicated by Fig. [U 



G 
P 

S r~j p 



P- 

const, 
1 



(21) 



Evidently, only S performs according to the mean-field 
predictions; G is linear in p rather than the expected 
cubic behavior, while P is constant rather than linear. 
Therefore, in this limit the WS network exhibits critical 
exponents a = 1, [3 — 0, and 7 = 1 in contrast to the 
mean- field values in Eqs. (flUj) . We note for future refer- 
ence that the critical exponents found for the WS network 
satisfy the scaling exponent identity a + 2-f + (3 — 2. 

Thus, the above results demonstrate that the WS 
graph exhibits an unusual transition as p — > 0. Rather 
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FIG. 4: Numerical results for the standard (n = 1) Watts- 
Strogatz network: (a) Cluster size generating function G(p), 
(b) percolation probability P(p), and (c) the mean finite- 
cluster size S(p). 



than the generic mean-field behavior typical of percola- 
tion with general short- and long-range bond probabili- 
ties, the WS network displays a transition between two 
percolating phases, with P jumping discontinuously from 
a finite value to unity while S diverges continuously as 
1/p. In the following section, by considering a generaliza- 
tion of this model we provide an analytical explanation 
for this behavior. 



B. Scaling 

The original choice of Watts and Strogatz, to fix the 
number of added long-range bonds to equal the number 
of short-range bonds removed, was motivated by the de- 
sire to compare the properties of graphs having the same 
total number of bonds for different values of p. However, 



when applying their model to physical systems there is 
no reason a priori to assume this to be the case. In some 
cases long-range bonds are more "costly" than short- 
range bonds and we would expect the relative number 
of long-range bonds in the system to be fewer. Alter- 
natively, in the context of neural connections, suitable 
training of a growing cortex can result in a relative in- 
crease in the number of long-range bonds. 

With these considerations in mind, we now define a 
generalized WS graph by the simple expedient of allowing 
the number of long-range bonds added for every short- 
range bond removed to vary continuously; Fig. [TJi gives 
an example of such a generalized graph. Thus for such 
graphs, the relationship between p s and p = pi is given 
by 



p = Pi = n(l -p s ). 



(22) 



An illustration of some of the trajectories for different 
values of n is given in Fig. [31 Substituting Eq. (|22p into 
Eq. (fT2j) gives us the cluster-size generating function for 
nearest- neighbor generalized Watts-Strogatz graphs, 



G(n,p, h) = — min[/(m, n,p, h)] 7 
where for convenience we have defined 



f(m,n,p,h) =p(m - l) 2 - 



(p/r 



e h+2pm -l+p/n 



(23) 



(24) 



We now restrict our attention to trajectories along 
which P is small in the p — > limit, which we expect to 
be those in the immediate vicinity of, and beneath, the 
transition line in Fig. [3J While the restriction on m be- 
ing small means that any results derived using it are not 
strictly applicable to the n — 1 case treated numerically 
in Sec. IIII K[ we expect that universal quantities such as 
critical exponents should agree in both cases. With this 
in mind, we make a small-m expansion of Eq. (124|) to give 
the equivalent of Eq. (fl3|) . 

We start with the case h — 0. The free energy then 
becomes 



f(m,n,p,h 



0) = P ( 1 - - 

n 



+ -pm 3 (6n 2 
o 



pm 2 ( 1 + 2p — An) 
-6pn+p 2 ). (25) 



Considering the coefficient of to 2 , we immediately see 
that the percolation transition occurs when 



l + 2p 



(26) 



Therefore in the p — > limit, the transition line in Fig.[3J 
comes down linearly with a slope of — 1/4. As in Eq. (|13p , 
the presence of a cubic term does not imply a first-order 
transition since m = P is confined to the range (0,1). 
Defining S n = n — 1/4, and setting df /dm = to obtain 
to, we find 



P = TO = 







12n 2 -12rip+2p 2 



n< \(1 +2p) 
n>l(l + 2p) 



(27) 
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This result is only valid for m<l, and so it follows that 
our expression for / in Eq. (|25[) is only valid for n < 1/4. 
We can write the singular parts of G and P in the p — > 
limit as 



G sing (p — > 0; n) 



0, <*„ < p/2; 
P<^, > p/2; 



(28) 



Once again, these results are quite distinct from the 
mean- field predictions of Eqs. (|16|) and (|17|) . Moreover, 
the results for S n > p/2, giving a = 1 and f3 = with 
P tending linearly to a finite constant as p — > 0, are 
in accordance with the numerically obtained behavior of 
Eqs. (j2"Tj) . arguing for the universality of Eqs. (|28[) and 
([29"]) at all n > 1/4 

Note that the result from Eq. (|29|) . that increasing p 
reduces the percolation probability, should not be sur- 
prising, since the total number of bonds in the system is 
proportional to (p/ +p s ) = 1 +p(l — l/ n )' Therefore for 
n < 1, increasing p reduces the total number of bonds 
in the system. This can also be understood by consid- 
ering the convex nature of the transition line in Fig. O 
all trajectories with \ < n < | will intersect the line 
twice, once at p = and again at p » 2<5 n . Moreover, the 
second transition does behave in the mean- field manner, 
meaning that P — > linearly as we approach it. Since 
when 5 n <C 1 the distance between the two transitions 
becomes vanishingly small, the percolation probability P 
must decrease from P = 4S n to P = linearly as we 
increase p through the increment from to S n /2. 

We now turn to calculating the mean finite cluster size, 
S, which is the equivalent of the susceptibility for a per- 
colation system. Equations ^ and |(SJ| imply that we 
can write 



5* = 



dm 
~dh 



(30) 



h=Q+ 



We therefore need to find the /i-dependence of to. This 
is simple to do if we notice that by defining 



to = to + — , 
2p 



we may express /(to, h) as 



/(to, h) = /(to, 0) Vhm + h. (31) 

4p 

Expanding G for small p, to, <5„ and h we find 



G = 



pmm 



+ — + 2m 2 (p-2S n ) 
2p 



- — (2p-<W„-l) 
P 



"^(2p-«n-l) 



1 / ft 
— TO 

2 V 2p 



3 i 



.(32) 



Minimizing the free energy with respect to to and ex- 
panding to lowest orders in p, 5 n and h, one obtains the 
magnetization as 



p(4f>-8<5„) ' 
163„-8p 



<5„ < P/2 



(33) 



Substituting this value into Eq. ([32|) . we get the free en- 
ergy expression near the singular point as 



.'3 h 
G = p[ -r + 7T 



3h 2 



4 2p 8p 2 (25„-p) 



(34) 



for S n < p/2, and 



3h 2 



(35) 

for <5„ > p/2. This implies that the singular part of the 
free energy can be written as 



where, 



G sing =pV^(/i), 



Sn_ 1 
p 2' 
h 



p 3 x 2 



and is a universal scaling function, obeying, 



4>x(h) 




x < 0, 
/i a; > 0. 



(36) 

(37) 
(38) 

(39) 



Therefore in the p — » limit, we find the critical be- 
havior of S as p — » to be 

f -n/(25„p) 5„ < p/2; 

S(p - 0; n) - ^ (V2 - n)/(2««p) <5„ > p/2; (40) 
[ l/(4p 2 ) 5„=p/2. 

The critical exponent for the divergence of S is therefore 
7=1 for <5„ 7^ p/2, and 7 = 2 for S n = p/2. These results 
for S show a number of interesting points. The first is 
that for S n ^ p/2, S diverges in agreement both with the 
mean- field prediction and the numerical result for n = 1. 
We also note that the amplitude for the divergence at 
$n = p/2 + is equal to that for S n = p/2 - . However, for 
S n = p/2 precisely, the percolation transition is accom- 
panied by a different divergence in S. Thus, while G and 
P display the same singular behavior for S n — p/2 and 
d n < p/2, the two cases are differentiated by the order of 
divergence in S. 



C. Other lattices 

Given the rich behavior of percolation on the simple 
WS model, it is natural to enquire if similar behavior ex- 
ists when the underlying lattice structure is of a higher 
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dimension. Returning to the considerations of Sec. HH 
we note that to treat the higher-dimensional case all we 
need do is to substitute the appropriate Go into Eq. (fT0| . 
Unfortunately, the exact form of Go is not known for 
dimensions higher than one (not counting the infinite- 
dimensional Bcthc lattice), and so an analytic solution 
of the higher-dimensional case is not possible by this 
method. Nevertheless, enough is known about the prop- 
erties of Go(psih) in higher dimensions to make some 
general statements about percolation in such graphs. In 
particular, close to the percolation transition we can 
write a form equivalent to the expansion in Eq. (|13p . as 

G(p s ,pi,0) = -pi + G o (p s ,0) - min 

| Pi m 2 [l - 2pi5 (p.)] + ^pfU ( Ps )m 3 + <3(m 4 ) J , 

where So = d 2 Go/dh 2 \ h=0 + is the mean finite-cluster size 
of the nearest-neighbor model on the underlying lattice, 
and U = -d 3 G /dh 3 \ h=0 > 0. There will thus be a 
percolation transition at the point 2pi = Sq 1 , again gov- 
erned by mean-field exponents. 

This result provides enough information to draw 
some conclusions about the behavior of generalized WS 
graphs in higher dimensions. In particular, in the one- 
dimensional case it was the intersection of small-world 
trajectories with the critical point at p — that gave 
rise to all the interesting behavior as p — > 0. In higher 
dimensions, however, small-world trajectories as defined 
in Eq. do not encounter any critical points as p — ► 0. 
Thus, we would not expect any critical behavior other 
than a mean-field transition should they pass through 
the transition line (in the (pi,p s ) space) at some point 
other than the origin. 

IV. CONCLUSION AND DISCUSSION 

We have examined the percolation properties of a class 
of WS graphs generalized by allowing the proportion of 
long-range and short-range bonds to vary with a param- 
eter n according to pi = n(l — p s ) = p. Such graphs 
then lie along "small-world" trajectories parameterized 
by n and p in the space of graphs with general (p a ,pi). 
Previous solutions of bond percolation on graphs with 
general (p s ,Pi) have been shown to giv e results in the 
same class as random graphs [H, H^, |30| , with the tran- 
sition between the percolating and non-percolating phase 
controlled by mean- field exponents a = — 1, j3 = 1, and 
7 = 1. 

An interesting aspect of the the original Watts- 
Strogatz model, and its generalization presented here is 
the interplay between the deleted short-range links and 
the added shortcuts. In this paper we have discussed sev- 
eral aspects of this interplay, including the discontinuous 
jump between the two percolating phases at p = 1 and 
the critical behavior near the percolation phase transition 
point. 



We have presented an analytical solution of generalized 
WS graphs, valid for n ^ 1/4, and a numerical solution 
for the standard (n — 1) WS graph, which together show 
that the critical behavior of such networks in the p — > 
limit falls into one of three regimes of behavior depending 
upon the value of n. Moreover, in none of these regimes 
is the transition described by standard mean-field. Tra- 
jectories for which n > 1/4 display a transition between 
two percolating phases in which the percolation probabil- 
ity, P, jumps discontinuously from a finite value to unity 
at the transition point while the mean finite-cluster size, 
S, diverges. The critical exponents associated with the 
transition are a = 1, /3 = 0, and 7 = 1. Trajectories with 
n < 1/4 and n = 1/4 both display a percolation transi- 
tion with a P jumping discontinuously from to 1 and 
critical exponents a = 2 (3?| and (3 = 0; however they 
are differentiated by the behavior of S, which diverges 
with exponent 7 = 1 for n < 1/4 and 7 = 2 for n = 1/4. 

We have further proposed that all three regimes of be- 
havior can be unified within a single scaling form for the 
cluster-size generating function, G, that is valid in the 
vicinity of the critical point p = 0. According to this 
proposal, the failure of the critical exponents for n < 1/4 
to satisfy the identity a + 2/3 + 7 = 2 can be related 
to asymptotic zeroes of the scaling function. We have 
also considered the percolative behavior of generalized 
WS graphs on higher-dimensional lattices. While no ex- 
act solution exists, general considerations of the form of 
the phase diagram for systems with general (p s ,pis) indi- 
cate that there should not be any critical behavior along 
small-world trajectories. 

To conclude, we note that, as far as we are aware, stud- 
ies of the dependence of the graph diameter, I, on the 
long-range bond probability p in WS graphs have so far 
focused exclusively on the n — 1 case. However, our anal- 
ysis of bond percolation in generalized WS graphs has 
shown that varying n can have important consequences 
in case of a 1-dimcnsional underlying lattice. In partic- 
ular, according to the form of our scaling function, in 
the p — ■* limit it is the quantity (n — 1/4) /p that is the 
physically important parameter in percolation. An inter- 
esting question therefore arises as to whether the graph 
diameter l(j>) has a corresponding dependence on n, and 
in particular whether the value n = 1/4 has a physical 
significance beyond the percolation behavior presented 
here. 

It should be noted that the original WS model has 
been extended mainly to fc-rings, rings where each node 
is connected to its k nearest neighbors on each side (for a 
total of 2k nearest neighbors bonds per site). While this 
model is also one dimensional, and does not percolate 
without long-range bonds (unless p s = 1), the singular 
behavior as p — > could well be different from the case 
k = 1. For a /c-ring, a lower bound on the asymptotic 
probability that a node does not belong to a long "super- 
node" extending to its left behaves as (1 — p s ) k . Using 
Eq. (|A6j) with p' s replacing p s , and with the approxima- 
tion 1 — p' s ~ (1 —p s ) k , one obtains that for k > 1, y — > 
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for p s — > 1. Therefore, the behavior near the fully con- 
nected ring state is analytic — in contrast to the singly 
connected ring no jump discontinuity exists. 
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APPENDIX A: 



THE GENERATING FUNCTION 
APPROACH 



In this Appendix we develop a different approach to 
studying the percolation transition in small world net- 
works. We use the generating function formalism, stress- 
ing the topological, rather than thermodynamic struc- 
ture of the network. The percolation process can be per- 
ceived as consisting of two stages. In the first stage short 
range links are removed from the network with probabil- 
ity 1 — p s . The remaining network consists of isolated 
islands of varying sizes. We will term a group of nodes 
connected by a chain of short-range links a "super-node." 
This construction can be viewed as a renormalization of 
the network, where each super-node is a node in the new 
network, having weight proportional to its original size. 
In the second stage long-range links are added to the 
network, and we study the connectivity between super- 
nodes through these long-range links. The probability, 
P(d), of a node to belong to a super-node of size d is the 
number of possible consecutive sets of size d including 
this node (which is just d) times the probability of the 
d — 1 links between these d nodes to be intact, and the 
two links leading to nodes neighboring this super-node 
to be removed. Therefore, 



P(d)^dpt 1 (l~ Ps ) 2 



(Al) 



and the generating function for the super-node size is 



S(x) 



E^ 1 

rf=i 



X(l-Psf 
1 - Xp s 



(A2) 



Consider now the distribution of the number of long 
range links emanating from a super-node of size d, since 
there are piN edges having 2piN ends (links) randomly 
distributed on the ring, we expect a Poisson distribution 
of the links with mean 2pi per node, or 2dpi per super- 
node. Therefore the probability of having k links from a 
super-node is 



P(k\d) 



(2dpi 



-2dp, 



k\ 



(A3) 



and the joint generating function for super-node size and 
degree is 



D(x,y) = E P W P ( fc l rf ) 



d.k 



(1-Ps 



x d y k 



=2pi(2/-l) 



(A4) 



(1 - psxe^y- 1 )) 2 
To calculate the distribution of component sizes ob- 
tained by following a link, one should notice that the 
probability of reaching each node by following a long 
range link is the same. Therefore, the probability of 
reaching a super-node is proportional to its size and simi- 
lar to the probability that a node belongs to a super-node 
of size d. Hence, the distribution of cluster sizes reached 
by following a link (which is similar to the distribution of 
cluster sizes in general due to the Poisson distribution) 
is given by the self consistent equation 



(A5) 



From this self-consistency condition all cluster and per- 
colation properties can be obtained. In particular, when 
finding the solution of the equation 



V P = D(i,y P ), 



(A6) 



if y p = 1 there exists no giant component, while for 
y p < 1 a giant component exists. The size of the giant 
component is determined to be S = 1 — y p . As discussed 
before, the behavior as p s —> 1, with pi = 1 — p s is spe- 
cial: As this limit is approached, S — > ^ « 0.866, with 
a discontinuous jump to S = 1 for p s = 1 and pi = ! 

Expanding Eq. (|A5[) in powers of e for y = 1 — e and 
x = 1 gives the phase transition behavior for the model. 
One obtains, 



1 -e = 1 



2pi{p s + 1) 4pf(pg + 4p 8 + l) c2 



Ps ~ 1 " " 2(p s - l) 2 
leading to the critical percolation threshold at 



2pi(p s 



1) 



1 



= 1 . 



- Ps 



(A7) 



(A8) 



Near the threshold it can be seen that the quadratic term 
in e will always exist unless p s — > 1 or p; — * 0. For 
a generalized n the behavior depends on the expansion 
of the linear terms in e as a function of the deviation 
from the critical point. Furthermore, for the original WS 
model with p = pi = 1 — p B it is easily seen that the whole 
< p < 1 range is within the percolating regime. 
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